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Abstract 

We study a quantum process that can be considered as a quantum 
analogue for the classical Markov process. We specifically construct a 
version of these processes for free Fermions. For such free Fermionic 
processes we calculate the entropy density. This can be done either 
directly using Szego's theorem for asymptotic densities of functions of 
Toeplitz matrices, or through an extension of said theorem to rates of 
functions, which we present in this article. 

1 Introduction 

Quantum channels describe the black box dynamics of small open 
quantum systems, i.e. a quantum system evolving in contact with 
an inaccessible environment. Technically, a channel is a completely 
positive map, which maps an input density matrix into an output 
density matrix. It corresponds to a one-shot random evolution of the 
system. A classical channel is a stochastic matrix. 

In this article, we consider the construction of a quantum process 
associated to a channel, much like a stochastic matrix generates a 
Markov process. Introducing in a quantum system multi-time cor- 
relations that are compatible with a given channel is, however, much 
more delicate than in the classical context. Such an amplification to 
a process is not generally possible and, if possible, the process is not 
unique. We focus on entropic properties of such processes, both for 
determining extensions with minimal entropy and obtaining a measure 
of randomness in the given channel. 

The construction uses a generalization of matrix product states 
which was introduced under the name of finitely correlated states, 
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see [1, 10]. While matrix product states prove to be a very useful class 
of pure states on quantum spin chains [19, 17], suitable for studying 
ground state properties, one needs to go beyond such states in the 
context of channels due to the mixing of pure states by generic chan- 
nels. In fact, even in the classical context, the class of processes we 
consider includes hidden Markov processes. 

In the study of the information carrying capacity of classical chan- 
nels with memory, the entropy density of hidden Markov processes 
also arises [23]. The entropy density of finitely correlated states is ex- 
pected to play a role in the information capacity of quantum channels 
with memory. 

In this article, however, we consider a simpler problem and intro- 
duce a construction of free Fermionic Markov processes compatible 
with a free Fermionic channel. We show in particular that, instead of 
through a direct calculation, the entropy density can also be obtained 
as the asymptotic entropy production under the shift dynamics. 

The structure of the article is as follows. In Section 2 we re- 
view properties of classical Markov and hidden Markov processes. We 
pay particular attention to a method to calculate the entropy den- 
sity, based on a De L'Hopital-like property of strongly subadditive 
functions. In Section 3 we introduce the quantum version of hidden 
Markov processes. In Section 4 we consider a free Fermionic version 
of such processes. We then turn to the main result in Section 5. We 
show that the De L'Hopital-like property, which connects averages of 
functions to their growth rates, can be extended to a much wider class 
than the strongly subadditive functions. As the density matrices of 
free Fermionic systems are basically Toeplitz matrices, this amounts 
to an extension Szego's theorem for averages of functions to rates. 

2 The classical case 

We first consider classical Markov and hidden Markov processes. Let 
P be a stochastic matrix over a finite state space Q, = {1,2, .. . ,d}: 
the entries of the d x d matrix P are non-negative and the row sums 
are equal to 1. The entry P U1U2 specifies the jump probability from 
state uj\ to state uj<i and hence P defines a stochastic dynamics in 
discrete time. Generically P has a non-degenerate eigenvalue 1 and 
so has its transpose P T . The Perron-Frobenius theorem asserts that 
the absolute values of the eigenvalues are not larger than 1 and that 
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the entries of the eigenvector of P T corresponding to the eigenvalue 
1 can be chosen non-negative. A proper normalization provides us 
therefore with a probability vector over Q, such that P T fi = [i. For 
a generic P, (i is faithful and we have exponentially fast convergence 
to the invariant measure: there exist C > and < 7 < 1 such that 

\\(P T ) n u — ! < Cl n , n e N, v probability vector. (1) 

Moreover, P generates a natural stationary stochastic process by 
assigning to a path (uq,uji, . . . ,co n ) the probability 

(iOo, Ll>i, . . . , W n )[ n ] = Mwo-fwotJi-PaJi w 2 ' ' ' P>„_i w„; OJj Gfl, n = 0, 1, . . . 

(2) 

This is a one step Markov process: the probability for reaching the 
state ui n at time n given the full history (wo, oji,... , w n -i) is the same 
as that for reaching u n starting at time n — 1 at uj n -i- 

The entropy production or rather the mean entropy of this Markov 
chain is a natural way to quantify the randomness of P 

h ( P ) : = f JSo^ H «>IP.»-l]) ^ 

Here, H is the usual Shannon entropy of a probability vector. In fact, 
in the event of multiple stationary measures for P the entropy also 
depends on the chosen initial measure. 

For strongly subadditive function, such as the Shannon entropy, 
the following discrete version of De L'Hopitaks rule can be proven[2, 
15]: 

n Hm I H « } [0 , n _ 1] ) =M (H(( ) [0>b] ) - H(( ) [0>B _ 1] )). (4) 

Using this equality a simple calculation shows that the entropy density 
of the Markov process (2) is given by 

h(P) = <H trans ) At) (5) 

where H tra ns(w) is the entropy of the conditional probabilities related 
to the transition from oj to the next state: 

Htrans (w) = ~ ^ P ^ lo § P ^ ' ( 6 ) 
cr 

This construction is however difficult to carry over to quantum 
systems due to the prominent role of paths. The probabilistic nature 
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of quantum mechanics and the non-uniqueness of the choice of basis 
for the Hilbert space of the system make paths an unnatural concept 
in quantum mechanics. A construction that is better suited for gener- 
alization is based on positive maps. We consider stochastic matrices 
with d rows and d 2 columns. An observable on the discrete state space 
can be seen as a vector / € R d and we use the notation 1 for the 
constant function 1, i.e. every entry of 1 is equal to 1. 

Construction 1. Let P be a stochastic d x d matrix with invariant 
measure /x and let Q be a d x d 2 stochastic matrix that satisfies the 
compatibility condition 

Q(/®1) = Q(1®/) = P/, /€R d . (7) 

Any such Q defines a stationary measure on the half-chain x N f2 with 
marginals 

</n> = li(Q{Q ® 1) • • • {Q ® 1 ® • • • ® 1) (1 ® /„)) , fn € R d . (8) 

□ 

The set of stochastic matrices Q obeying (7) is closed, convex and 
non-empty. E.g. the Markov chain (2) is obtained by choosing 

Q{f®g) = P(fg), f,geR d , (9) 

where fg is the entry wise product of / and g. For a general Q, the 
measure (8) is a stationary hidden Markov process. 

The mean entropy of a hidden Markov process can be computed 
using a method due to Blackwell, see [9] and [6]. This computation 
is based on the discrete version of De L'Hopital's rule for the mean 
entropy given in Equation 4. The relation between the n and n — \ site 
marginals of a hidden Markov process is given by a transfer matrix like 
relation, as seen from (8). This allows to express the mean entropy as 
an average of entropies of probability vectors over 

n lim 1 H« ) n ) = J <p(dv) Hl rans (^). (10) 

In this formula, v is varies over the set of probability vectors over O 
and ip is a measure on this set of probability vectors. The measure (p 
is the unique stationary measure of a dynamical system on probability 
vectors over Q that is determined by Q. 
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This formula bears some similarity to Eq. 5. The measure ip weighs 
the possible past paths, much as the measure p. in Eq. 5 weighs the pos- 
sible configuration at the previous time step. As the hidden Markov 
process also has correlations with previous time steps, this weighting 
term gets significantly more complicated. The entropy term H(. rans (^) 
is an entropy function related to the transition from one state to the 
next, much as the function H trans (^) in Eq. 6 is determined by the 
transition probabilities P wa . 

Numerical experiments suggest that among the extensions that sat- 
isfy the compatibility condition (12), the Markov chain extension (9) 
has the smallest entropy. 

3 The quantum case 

The natural quantum analogue of a stochastic matrix is a unity pre- 
serving completely positive (CP) map Y acting on the d-dimensional 
complex matrices Md- Such maps send a pure state into a mixed 
one and are therefore stochastic. Generically Y has a non-degenerate 
eigenvalue 1, the corresponding eigenvector of the transpose, mostly 
called the dual, is a faithful density matrix p and exponentially fast 
return to equilibrium holds: for any initial density matrix a 

|| a o T n — p|| < Cj n , n e N, a density matrix. (11) 

Unlike the classical case, where there is a trivial connection be- 
tween stochastic matrices and Markov processes, there is no straight- 
forward extension to a process. A first reason is that a general density 
matrix admits many convex decompositions in pure states, a mixed 
quantum state is not uniquely linked to an ensemble albeit that there 
is a preferred decomposition, namely the spectral decomposition. A 
second reason is that the map Y not only mixes pure states but also 
rotates them which prohibits a description in terms of paths. 

This makes quantifying the randomness of a CP Y not evident. At 
least two proposals can be found in the literature: the minimal output 
entropy [16] and the map entropy [24]. Here we propose an approach 
in the spirit of Markov chains. 

Construction 2. Let Y : Md — > Md be a unity preserving CP map 
with invariant state p and let A be a unity preserving CP map from 
Md ® Md to Md that satisfies the compatibility condition 

A(X <g) 1) = A(l <g>X) = Y(X), X e Md- (12) 
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The quantum Markov chain defined by A and p is then the finitely 
correlated state oj [11] on the semi-infinite quantum spin chain ® N "A4d 
with marginals p n on the sites [1,2, ... ,n] given by 



u(X n ) =Tr(p n X, 
= Tr(pAc 

where X n £ ®i Ma 



(13) 

Tr(p A o (A <g> id) o • • • o (A ® id <g> ■ ■ ■ <g> id)(l ® X n )) 



□ 



Note that this construction contains the class of classical hidden 
Markov processes. 

We can now associate an entropy to a quantum Markov chain as 
in the classical case 

h(A,p) :=s(w) := lim - S(p n ) (14) 

n— >oo fi 

where S is the usual von Neumann entropy Generically, T has a non- 
degenerate eigenvalue 1 so that p is uniquely determined by T and 
that there is no p dependence in (14). Clearly a number of issues have 
to be addressed: for which T can one find a A that satisfies (12)? How 
does h(r, A) depend on A? Can one compute the mean entropy (14)? 



4 A Fermionic model 

Quantum states are mostly indirectly given, typically as ground or 
equilibrium states for a given interaction and are hence difficult to 
work with as there is for example no explicit density matrix. Also, 
in general one has to deal with an enormous amount of parameters 
when the number of particles grows. As the number of components 
grows, typically the number of parameters grows exponentially. Free 
Fermionic states [22, 20, 5] form an exception in both respects. These 
states describe systems of non-interacting fermions. They are given by 
an explicit recipe, reducing the calculation of higher order correlation 
to a simple combinatorial combination of second order correlations. 
Hence not only can they be calculated explicitly, they are also fully 
described by their second order correlation, resulting in a significant 
reduction in parameters. 

In this section we first discuss some of the properties of free Fermionic 
states. We then introduce a Markov construction similar to the one 
given in Section 3. 
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4.1 Free states and maps 

The algebra 21(f)) generated by the canonical anticommutation rela- 
tions (CAR) describes the observables of a system of Fermions with 
one-particle space $). It is generated by the identity and the creation 
and annihilation operators a* (</?) and a((p) that obey the relations 

i) <p t— >• a* {ip) is C-linear (15) 
it) {a{tp) , a(ip)} = and {a(tp) , a*(^)} = (<p , (16) 

A useful set of states, called free, quasi-free, Gaussian, or determi- 
nantal, is determined by a simple combinatorial rule. Given a symbol 
Q € 53(f)), the state ujq vanishes on every monomial except for 

uq(o>*{<Pi) • • -a*(y? n )a(V>n) ■ ••a(V'i)) = det([(^ fc , Qipe)]). (17) 

Positivity holds if and only if < Q < 1. The set of symbols 

Q{%) = {Q\Q linear operator on U such that < Q < 1} (18) 

is convex and weakly compact. Convexity at the level of symbols is 
very different from convexity at the level of the free states. Never- 
theless it can be shown that a free state is pure, i.e. extreme in the 
full state space of A(H), if and only if its symbol is an orthogonal 
projector, i.e. an extreme point of Q(H). 

Important quantities like the entropy of free states are expressible 
in terms of symbols, e.g. 

S(Q) = -TrQlogQ-Tr(l-Q)log(l-Q). (19) 

Let P be an orthogonal projection on H, then the restriction of the 
free state ojq on A(H) is a free state on the sub-CAR algebra A(PTi) 
with symbol PQP. Conversely, a pair of free states ujQ i on A(7ii), 
i = 1, 2 extends to a free state coq 1& q 2 on A(Hi © %2) by putting 

u Ql(BQ2 (X 1 X 2 )=u Ql (X 1 )u Q2 (X 2 ), XieAiUi). (20) 

Free, identity preserving, CP maps Aa,b '■ 21(f)) — > 2l(^) are de- 
termined by a pair of linear operators A : fj — >■ R and B : fj — > S). For 
monomials of degree two 

A A , B {a*( V )a(iP)) = a*(A V )a(Ai;) + (Y> , B<p)l. (21) 



7 



For more details, see [8]. Complete positivity holds if and only if 
< B < 1 — A* A. As for free states, we introduce the set 

CV{U,K) = {(A,B) \A-.n -»• K and B :U linear 

operators such that < B < 1 - A* A}. 

We use CP{U) for CV{U,U). The set of free, CP maps extends that 
of free states by putting 

Q e Q(H) ' y (0, Q) e CV(H, K). (23) 

Another special distinguished class of maps are the free homomor- 
phism from A(H) to A(JC) 

{(V, 0) € CV{U, K) | V : H K isometric}. (24) 

The set CV(H, K.) is also convex and weakly compact. Free CP maps 
transform free states into free states and one checks from (17) and (21) 
that 

° Aa,B = ^A*QA+B- (25) 

The construction of the quantum Markov process consists of using 
a completely positive map to contract the observable and then apply- 
ing a single-party state that is invariant under a completely positive 
map. We have the following lemma concerning the existence of such 
invariant states. 

Lemma 1. Let Aa,b be a completely positive free transformation of 
A(Tl) as in (21) and assume that dim(%) < oo, then Aa,b has a 
unique invariant state if and only if \\A\\ < 1. Moreover, the unique 
invariant state is free with symbol Q determined by 

Q = A*QA + B. (26) 

Proof. The condition \\A\\ < 1 is equivalent to the non-existence of 
non-trivial solutions to the homogeneous equation Q = A*Q A. It 
has to be satisfied to have uniqueness of the solution of the invariance 
condition (26) for symbols. Conversely, suppose that \\A\\ < 1, then 
there exists by the fixed point theorem for contractions a unique Q 
such that 

Q = A*QA + B. (27) 

This Q satisfies < Q < 1 as we may obtain Q by iterating the map 
X i — y A*X A + B with initial value 0. It is then easily checked that 

hm A\ B = u Q (28) 
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which guarantees both the uniqueness of the invariant state and its 
free character. □ 



4.2 Constructing a chain 

We now have the necessary ingredients to introduce the free Fermionic 
counterpart of Construction 2. There are natural embeddings 

a(ip) h-> a(<p ffi 0) and a(ip) i-> a(0 © ip) (29) 

of 2l(ft) and 2l(/C) into 21 (ft © /C). Both factors together generate 
the large algebra and they satisfy graded commutation relations as 
creation operators in different factors anticommute. We can trans- 
port the construction of the quantum Markov chain (12,13) and its 
entropy (14) to the free Fermionic setting. The spin chain algebra 

ffi N Md is replaced by a semi-infinite Fermionic chain 21(® N ft) where 
2l(ft) is now the one site algebra. 

The basic ingredient is a free CP transformation Aa,b of 2l(ft) and 
we look for free CP maps A c ,d from 2l(ft © ft) to 21 (ft) such that 

Ac,D ° 3i = Ac,d ° 32 = A a ,b- (30) 

Here, j\ and j2 are the natural embeddings of 21 (ft) into the first and 
second factor of 2l(ft ffi ft) 

Ji(a((p)) = a(tp ffi 0) and j 2 (a((p)) = a(0 ffi tp). (31) 

Applying the compatibility condition (30) to monomials a(<p) and 
a* (ip)a(ip) we see that 



C = [A A] and D = 



B X 

X* B 



(32) 



where X is as of yet undetermined and allows for some freedom in the 
choice of D. Because of the structure of free CP maps, the compati- 
bility conditions (32) are not only necessary but also sufficient and we 
can rephrase the whole construction on the level of symbols. Doing 
so, graded tensor products become direct sums. 

Construction 3. Let (A, B) € CV{U) and let Q € Q(ft) be such 
that ojq is invariant under A^,s: 

Q = A*QA + B. (33) 
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Let X : % — > H. satisfy the compatibility condition 

(C, D) € CV(H © U, U) with C and D as in (32). (34) 
The free Markov chain defined by X and Q is the symbol 

Qoo = w-lim P n R n P* on © N U (35) 

n— >oo 

where 

Pn ■ n © (e^^) (©£=o^) : ^ Vn ^ V'n (36) 

i?o = Q and i? n+ i = (C* © (ffi n l)) R n (c © (ffi n l)) + (d © (© n 0)) . 

(37) 

□ 

There is some freedom in choosing the channel Aq\d- The operator 
X has to be chosen such that the Ac,d is completely positive, i.e. 
< D < 1 — C*C. One may wonder if and when this is possible. 
The question of existence of compatible channels is answered by the 
following lemma. 

Lemma 2. The compatibility condition (34) is satisfiable if and only 
if 

A* A < min({i !,!-£}). (38) 

Proof. We look for the necessary and sufficient conditions for the ex- 
istence of a X : % — > % such that 



' B 


X 


> and 


"l - 


X* 


B 







A* A - B -A* A - X ' 
[*A -X* 1 - A* A - B 



> 0. 



(39) 



Clearly < B < 1-A*A as (A, B) G CV{%). The remaining positivity 
conditions are then the existence of S and T with 



\\S\\ < 1, ||T|| < 1, X = BiSB2, and 

A* A + X = (1- A* A - £)3T(1 - A* A - £)i 



(40) 



Replacing S and T by their Hermitian parts, we may restrict to Her- 
mitian X and so we need 



[-B , B] n [-1 + B , 1 - 2AM - B] ^ 



(41) 



10 



or, equivalently, that 

[1 , 1 + 2B] n [2B , 21 - 2A*A] + 0. (42) 
But this is the case if and only if 

max({l, 2B}) < 21 - 2A* A or A* A < min({± 1,1- B}) . (43) 

□ 

Let us look at this compatibility condition for a simple case. 
Example 1. If % = C, we have 

D=\- I 

x o 

with a, x € C and 6 € R. From the complete positivity of A a ^, we 
know that < b < 1 — \a\ 2 . The complete positivity conditions for C 
and .D limit the choice for x. From < D we see that 

|x| < 6. 

From D < 1 - C*C on the other hand, we get that 

\x + |a| 2 | < 1 - [a| 2 - 6. 

These two inequalities means that x has to lie in the intersection of 
two circles in the complex plane, one centred at with radius r\ = b 
and another one centred at — \a\ 2 with radius r2 = 1 — \a\ 2 — b. These 
two circles have an intersection when the distance between the centres 
is smaller than the sum of the radii. Hence, the channel is extendible 
if 

,2 1 

i«l 2 < 5 

which corresponds to the conditions in the lemma. 

Given the constituents of the Markov construction, the channel 
Ac,d and the invariant symbol Q, the symbol of the full process Qoo 
can easily be determined 

Proposition 1. The symbol in (35) is an Hermitian block Toeplitz 
matrix with entries 

(Qoo) lt = Q and {Qoo) ii+n = (A*) n (Q -B + X). (44) 
Here i = 0, 1, 2, . . . and n = 1, 2, 3, . . . 

Proof. The proof consists in a straightforward computation of the 
consecutive R n in (37) combined with the invariance equation (33). 

□ 



and C = [a a] , 
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5 Fermionic Entropy density 



In this section we compute the entropy h for the Fermionic Markov 
process constructed in Section 4. We can associate an entropy to a 
Fermionic Markov chain using (19) 

h(X,Q) := lim -S{P n R n P*) (45) 
,= l im - (-TrP n R n P*\og(P n R n P*) 

n->oo n V 

- Tr(l - PnRnPl) log(l - PuRnP*)) ■ (46) 

A first method to compute this relies directly on the expression (19) 
for the entropy of a free state in terms of its symbol and on the struc- 
ture of the symbols Qoo in Proposition 1. A second way is to rewrite 
the entropy as the asymptotic rate of disorder, as in the classical case, 
see Section 2. This last approach was used in [6, 9] to compute the 
entropy of a hidden Markov process. The first method uses the full 
local restrictions of the state while the second relies on the incremental 
structure of the local states given by a transfer matrix like construc- 
tion, see (13) and (37). 



5.1 Direct approach 

The first approach to calculating the entropy density uses an extension 
of Szego's theorem to block Toeplitz matrices T. This theorem allows 
to calculate asymptotic densities of trace functions of Toeplitz matri- 
ces. A block Toeplitz matrix is a block matrix T where the blocks 
along diagonals are equal 

— Pi+kj+k i 

where Tjj denotes a block elements. Using Szego's theorem, we can 
write densities 

l im Tr ZiZ™) 

n->oo n 

of a matrix function / and the finite projections T n = P n TP n in terms 
of a generating function T(0). The Fourier coefficients of this T{6) are 
the elements on the diagonals of T. We will now formulate this more 
precisely. 
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Let T : [— n, tt[—> A4d be an essentially bounded measurable matrix- 
valued function on the circle and denote its Fourier coefficients by 



T(k) :=± JjU>T{9)e 



ike 



eM d . 



A function T is essentially bounded if there exist a constant M such 
that \T(8)\ < M almost everywhere. The operator 



/f(0) f(l) f(2) ...\ 

f(-l) f(0) f(l) .. 

f(-2) f(-l) T(0) .. 

V : : ••/ 



defined on £°(N) ® C d extends to a bounded linear transformation of 
£ 2 (hl) ® C d . Operators of this type are block Toeplitz matrices and 
one has 

||f|| = HTlloo = esssup ||T(6»)|| , 


where the essential supremum of T is the infimum of all constants M 
that bound \T(9)\ almost everywhere. 

The Toeplitz matrices we are interested in are symbols and hence 
self-adjoint. For such Toeplitz matrices, we have that T* = T if and 
only if the function T takes values in the Hermitian matrices. 



5.1.1 Szego's theorem 

An extension of Szego's theorem to block Toeplitz matrices character- 
izes the limiting spectrum of principal submatrices P n T P n in terms 
of the generating function T, see [18]. Here P n projects on the first n 
blocks in £ 2 (hl) (g) C d . We obtain here a more general characterization 
of such limiting submatrices. 

Let us denote for a simply connected compact subset /C of C by 
H(K.) the set of continuous functions / : /C — > C that are holomorphic 

o 

in the interior K of K.. Mergelyan's theorem [21] asserts that the 
complex polynomials in the indeterminate z are dense in H(K.): for 
any / € H(IC) and e > there exists a polynomial p e such that 

max|/(z) -p e (z)\ < e. 
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Finally, let us denote by E n the conditional expectation from S(^ 2 (lNl)) ( 
Ma —> Md which traces out the first n blocks 



^ n— 1 

M*) '=-Y, x »* M + 

3=0 



We get the following generalization of Szego's theorem [12]. 

Theorem 1. Let {71, T 2 , . . . , T fe } C £°°([-7r, ?r[, A^ d ) 6e aucft too* 
every Tj(9) is 9-a.e. diagonalizable, let fj € T~L({z € C | jz| < ||7j||oo}) 
/or j = 1, 2, . . . , k and let Aj € Md, j = 1, 2, . . . , k + 1, then 

lim E n f(l ® Ai) h{PnfiP n ) (1 ® A 2 ) ■ ■ ■ f k {P n f k P n ) (1 ® A fc+ i)) 
= 27 d9M /l(Tl(0)) ^ 2 ' ' ' &( T *W) 

(47) 

Proof. The proof relies on a continuity argument combined with a 
standard counting argument. First remark that given e > every fj 
can be approximated by a suitable complex polynomial p e j 

, ,™ \fj(z) -p){z)\ < e. 

m<\\ T j\\oo 

Next, as ||Tj(0)|| < || Tj||oo a.e., we can use von Neumann's inequal- 
ity [13] to get 

||/iCZX<9))|| < max \f 3 {z)\ and (48) 

\\m{e)) -p)(T 3 {e))\\ = \\(fj-Pj)(Tj(e))\\ 

- I K^H (/j " ^ ~ I iffi (/j " ^ W " ^ (49) 

These estimates allow to replace the fj in (47) by polynomials. It then 
remains to verify the statement for monomials, but this reduces to a 
standard counting argument. 

In the case where there is only one function f(X) = X k and Aj = 
1, the density limit can be worked out as follows: 

1 1 11 

lim - Tr(P„f P n ) k = lim - V f hti2 f i2th . . . \ M (50) 

n->oo n n-5>oo n 

ii,...,i k =0 
1 " 

= lim - V f(i 2 -ii)f(i 3 -i 2 )...f(i k -h) 
h,...,i k =0 

(51) 
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By substituting v\ = i2—i\,... , Vk-i = ik — ik-i-> this sum becomes: 
1 n 

lim - Y Y T{v 1 )...f{v k - 1 )f{-v 1 -...-v k - 1 ), 

t)i,...,D fe _i=-n ngSn^i,...,^.!) 

where «S n (ui, . . . , Vfc-i) is the set of indices i such that v± + i,v± + V2 + 
i, . . . , v\ + ... Vfc-i + i G [0, n]. The number of elements in this set 
increases by exactly one when n goes to n + 1 , so in the limit we get 

oo 

lim V f(t;i)...f(t; fc _i)f(-t;i-...-t; fc _i). 

n->oo t-^ 

t)i,...,r; fc _i=-oo 

This is exactly the zeroth Fourier coefficient of T(6) h , so we get that 
the density equals 

The general case of the theorem can be worked out in a similar manner. 

□ 

To deal with entropy we don't need the full amalgamated extension 
of Theorem 1 of Szego's theorem but we may restrict ourselves for an 
Hermitian T to the asymptotic eigenvalue distribution of the principal 
blocks P n TP n . Taking the trace of (47) with a single / and all Aj = 1 
we recover the result [18]. We denote by inf(T) and sup(T) the largest 
and smallest real numbers such that 

inf(T) <T< sup(T) a.e. (52) 

The increasingly ordered eigenvalues (ti(0), T2(0), . . . ,Td(0)) of T{9) 
are measurable functions of that satisfy 

inf(T) < ti(0) < < T d {9) < sup(T). (53) 

The eigenvalue distribution of P n TP n is the atomic probability mea- 
sure 

\ea(P n fp n ) 

Theorem 2. With the assumptions of above 

w*-lim<5 n = 5oo, (55) 

n— >oo 
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where 




T k (0)<t 



dO. 



(56) 



An equivalent way to express this result is saying that for any 
continuous complex function / on [inf(T), sup(T)] 



This version is in some sense more natural as it doesn't involve the 
reordering of the eigenvalue functions used in the definition of the 
distribution function of the limiting eigenvalue distribution (56). 

We can apply Theorem 2 to the computation of the entropy, re- 
placing the Toeplitz operator T by Qoo in Proposition 1 and choosing 
in (57) 



Example 2. In case of a single particle space 7i = C as in the Ex- 
ample 1, the entropy can be calculated from the scalar version of the 
above function 



where x lies within the two circles determining the compatibility con- 
dition, as explained in Example 1. 

This scalar function is linear in x and the function / is concave in 
it's argument. Hence the minimal entropy is obtained on the border of 
the compatibility region, much like in the case of the classical Markov 
process and compatible hidden Markov processes described at the end 
of Section 2. 

5.2 Entropy rate approach 

The second approach expresses the entropy as an asymptotic rate. Let 
co be a translation invariant state on a quantum spin chain ® z M.^ and 
denote by P(o,n-i) its reduced density matrices, i.e. 



l im J_ Tr f(P n TP n ) = -L dO- Trf(T(6)). 
i^oo nd 2tt J_ n d 



(57) 



/(A) = -A log(A) - (1 - A) log(l - A) on (0, 1). 
The generating function T becomes 

6 i y Q+(Q -B + X)Ae td (l - Ae 10 )- 1 

+ A*e- i9 {l - A*e~ t9 )- 1 {Q -B + X*). 



(58) 



e^q+(q-b + x)ae l0 {l - ae^)" 1 + h.c. 



u{X) = Ttfacn-i)*) for X e ® n k zlM d . 



(59) 
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As we have seen before, subadditivity combined with translation in- 
variance guarantee the existence of the mean entropy of ui for intervals 

s(w) = lim - S(p( ,„_i)). (60) 



Moreover, strong subadditivity in conjunction with translation invari- 
ance also guarantees that 

(61) 



n \-> S(p( ,n-i)) * s monotonically increasing and 



s(u)= lim - S(p( , n _i)) = lim (S(p(o, n )) -S(p( , n _i)) 



n— >oo fi 



(62) 



Both properties (61) and (62) fail for general quantum states or for 
general finite local regions [15]. These results for quantum spin chains 
extend to Fermionic lattices using the natural embeddings (29) and 
restricting to even states [3]. The equality of both limits in (62) can 
be seen as a discrete version of de l'Hopital's rule. Obviously, the 
existence of the limit of the differences is a much stronger requirement 
than that of the averages. 

For free Fermionic states we can work at the level of symbols. E.g., 
strong subadditivity of entropy amounts to 

S(Qi 23 ) + S(Q 2 ) <S(Q 12 ) + S(Q 23 ) (63) 

where S is defined in (19) and where the symbols in the inequality are 
as follows 



Ql23 — 



Qi 

S* 



T 

Q2 

R* 



S' 
R 



Q 



12 



Qi 



T 

Q2 



and Q23 



Q2 
R* 



R 



(64) 



For more on functions that satisfy such strong subadditivity, see [4]. 

Below, we extend the equality of the limit of differences with that 
of averages, as in (62), to a much wider class of functions than the 
strongly subadditive ones, like the entropy of a symbol (19). The ar- 
gument relies on regularity of the functions and not on subadditivity 
or convexity which rarely hold. Szego's theorem follows as a conse- 
quence. 

We first show that the theorem holds for polynomials. 

Lemma 3. With the notation and assumptions on an Hermitian Toeplitz 
operator at the beginning of this section, for any polynomial p 

))=^£d6Trp(T(e)). 

(65) 



lim hip{P n fP n ) 

n->oo V 



Tr p(P n _ 1 TP n _ 1 
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Proof. It suffices to consider p(X) = X k for k G IN. We have 
lim Tr(P n f P n ) fe - Tr(P n _iTP n _i) fc 

n— »oo 

n n—1 

= i-ET^W"), - E^-lTPn-l)*))^ 
i=l i=l 
n n—1 

n— >oo ( E - £ ) 

U,...,ifc=l u,...,i fc =l 




= lim ( V - V )f(i 2 -ii)...f(»i-i fc ), 
ii,...,i k =l ii,---,ifc=l 

where denotes the block at position (i, j) inside of a block matrix 
Q. 

By substituting «i = 12 — i\ , . . . ,ffc-i = ik — ik-i, this sum be- 
comes: 

n 

n^oo E ( E ^ ) 

t)i,...,v fc _i— n i 1 65„(t)i,...,t) fc _i) ii65„_i(t)i,...,t; fc _i) 

f (ui) . . . f {v k -i)f (-V! - ... - Vk-l) , 

where S n (vi, . . . , Vk-i) is the set of indices i such that v\ + i, v± + V2 + 
i, . . . , t>i + . . . + i G [0, n]. For fixed ui, . . . , v k -i, the number of 
elements in these sets increases by exactly one when n goes to n + 1 . 
Hence, the difference of sums between brackets equals one and we 
arrive at the expression prescribed by the lemma. □ 

We can now use this lemma and an approximation argument to 
prove the general case. 

Theorem 3. With the notation and assumptions on an Hermitian 
Toeplitz operator at the beginning of this section, for any function f 
that is absolutely continuous on the interval [inf (T), sup(T)] 

lim (Trf(P n+1 TP n+1 ) - Tr f(P n TP n )) = ±- f d0 Tr f(T(9)). 

n^oo \ / 2TT J_ w 

(66) 
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Proof. By the continuity of the eigenvalues of a matrix and by the 
minimax principle [7] we can label the eigenvalues of P n TP n as 

{rfc \ k = l,2,...,d, i = l,2,...,n} with 

inf(T) < T™j < r£ < ■■■< t2j < sup(T) and r^ 1 < t& < r^ r 

(67) 

See [14] for a proof of this interlacing property. 

Let / : [inf(T), sup(T)] — > C be absolutely continuous with inte- 
grable derivative g, then for any A, r G [inf (T), sup(T)] 



f(X) = f(r) + £dxg( a 



Therefore 



— Jj d f\r{e)) = — J M{f(r) + J dxg{x)} 

t(6) 



f(r) + 



1 



2vr 



dx g(x) 



(68) 

(69) 
(70) 



d6 

/•sup(T) i 

/(t)+ / dxg{x)— I d6 V (T,x,6). (71) 

■/ in 



'inf(T) 



2vr J_ 



Here, r/ is defined as 

t)(t,x,6) 



1 T < x < t(9) 
-1 r(0) < x < t . 
otherwise 



(72) 
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By (71) we rewrite the increment of traces of f(P n TP n ) as 
Tr f(P n+1 TP n+1 ) - Tr f(P n TP n ) (73) 



EjE/^-E/^)} ( 74 ) 

k=l j=l j=l 

{E ^\x, r k {6)) ~ E lWi> **(*))} ( 75 ) 



d r su p( T ) 



1 PIT " />SUp(J ) 1 />7T 

= — / d9Tvf(f(e))-J2 dxg(x)— c 



<hUx,9), 
(76) 



with 

^(x,0) = X;\(r fc n ; 1 ,x,r fc (0))-^r ? (r^,x,r fc (^). (77) 

3=1 3=1 

The functions h\ are piecewise constant with values -1, or 1 due to 
the interlacement (67) of the -. As any integrable g on [inf (T), sup(T)] 
can be arbitrarily well approximated in £ 1 -norm by polynomials, the 
theorem follows from Lemma 3. □ 



6 Conclusion 

We have studied a free Fermionic version of quantum Markov pro- 
cesses. Due to the free Fermionic nature of the states we can char- 
acterize all possible Markov processes that one can construct. The 
density matrices of these states can be described by a Toeplitz matrix. 
By studying the behaviour of the eigenvalues of subsequent Toeplitz 
matrices, we have proved a new Szego theorem that allows to calcu- 
late the asymptotic entropy rate. This is what corresponds in the free 
Fermionic case to the method proposed by Blackwell [6]. 

It would be interesting to look for other quantum Markov pro- 
cesses for which an explicit calculation of the entropy rate is possible. 
Processes with a high symmetry are obvious first choices. Hopefully, 
such a calculation can lead to a quantum version of the Blackwell 
dynamical system. 
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